DATA PROCESSING METHOD AND APPARATUS OF SAME 

BACKGROUND OF THE INVENTION 
5 1 . Field of the Invention 

The present invention relates to a data 
processing method for identifying a recording medi\ani 
serving as a source of leakage of content data and an 
apparatus for the same. 
10 2 . Description of the Related Art 

Content to be shown for example at movie 
theaters and the like is distributed by for example 
copying it from master content onto a plurality of films 
and distributing the films to the movie theaters. However, 
15 pirated copies of movies and other content are sometimes 
prepared by for example capturing content images shown at 
a movie theater by a camcorder and recording the same on 
a magnetic tape or the like. As a countermeasure against 
such pirated copies, for example, U.S. Patent No. 6018374 
20 discloses the technique of projecting the name of the 
movie theater which is invisible when a person watches 
the images shown on the screen of the movie theater, but 
is shown when captured by a camera. 

Summarizing the problems to be solved by the 
25 invention, in the related art, if a movie theater 
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conspires with a manufacturer of pirated copies and 
covers the device for projecting the name of the movie 
theater on the screen or adjusts the infrared filter of 
the camera to produce pirated copies on which the name of 
5 the movie theater is not shown, the source (movie 
theater) cannot be identified. 
SUMMARY OF THE INVENTION 

An object of the present invention is to provide a 
data processing method for enabling identification of the 
10 source of leakage of content data leaked from 

predetermined recording media and an apparatus for the 
same* 

To attain the above object, according to a first 
aspect of the invention, there is provided a data 

15 processing method for identifying whether or not a 

content data was obtained on the basis of a recording 
medium having inherent variations in recording 
sensitivity which is produced by recording a first 
content data, comprising: a first step of detecting 

20 correlation between a difference between the first 

content data and second content data obtained from the 
recording medium and third content data which is an 
object for inspection and a second step of deciding 
whether or not there is any common point derived from the 

25 inherent variations in the recording sensitivity between 
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the second content data and the third content data on the 
basis of the correlation detected in the first step and 
identifying whether or not the third content data was 
obtained on the basis of the recording mediiim on the 
5 basis of a result of the decision. 

The mode of operation of the data processing method 
of the first aspect of the invention is as follows: At 
the first step, the correlation between the difference 
between the first content data and second content data 

10 obtained from the recording medium and the third content 
data is detected* Next, at the second step, it is decided 
on the basis of the correlation extracted at the first 
step whether or not there is any common point derived 
from the inherent variation of the recording sensitivity 

15 between the second content data and the third content 
data and it is identified whether or not the third 
content data was obtained on the basis of the recording 
medium on the basis of the result of the decision. 

The data processing method of the first aspect of 

20 the invention preferably further comprises a fourth step 
of capturing an image obtained from the predetermined 
recording medium to generate digital first content data; 
a fifth step of capturing an image obtained from the 
recording medium having the inherent variation to 

25 generated digital second content data; and a sixth step 
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of capturing an image obtained from the object recording 
medium to generate digital third content data, wherein 
the first step detects correlation between a difference 
between the first content data generated at the fourth 
5 step and the second content data generated at the fifth 
step and the third content data generated at the sixth 
step. 

According to a second aspect of the invention, there 
is provided a data processing apparatus for identifying 

10 whether or not a content data was obtained on the basis 
of a recording medium having inherent variations in 
recording sensitivity which is produced by recording a 
first content data, comprising: a correlation detecting 
means for detecting correlation between a difference 

15 between the first content data and second content data 

obtained from the recording medium and third content data 
which is an object for inspection and an identifying 
means for deciding whether or not there is any common 
point derived from the inherent variations in the 

20 recording sensitivity between the second content data and 
the third content data on the basis of the correlation 
detected by the correlation means and identifying 
whether or not the third content data was obtained on the 
basis of the recording medixim on the basis of a result of 

25 the decision. 
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The mode of operation of the data processor of the 
second aspect of the invention becomes as follows: The 
correlation detecting means detects the correlation 
between the difference between the first content data and 
5 the second content data obtained from the recording 

medium and the third content data. Next, the identifying 
means decides whether or not there is any common point 
derived from the inherent variations in recording 
sensitivity between the second content data and the third 
10 content data on the basis of the correlation extracted by 
the correlation detecting means and identifies whether or 
not the third content data was obtained on the basis of 
the recording medium on the basis of the result of the 
decision. 

15 According to a third aspect of the invention, there 

is provided a data processing apparatus for identifying 
whether or not a content data was obtained on the basis 
of a recording medixam having inherent variations in 
recording sensitivity which is produced by recording a 

20 first content data, comprising: a correlation detecting 
circuit for detecting correlation between a difference 
between the first content data and second content data 
obtained from the recording medium and third content data 
which is an object for inspection and an identifying 

25 circuit for deciding whether or not there is any common 
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point derived from the inherent variations in the 
recording sensitivity between the second content data and 
the third content data on the basis of the correlation 
detected by the correlation circuit and identifying 
5 whether or not the third content data was obtained on the 
basis of the recording mediiim on the basis of a result of 
the decision. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 These and other objects and features of the present 

invention will become clearer from the following 
description of the preferred embodiments given with 
reference to the attached drawings , wherein : 

FIG. 1 is a view of the configuration of a data 
15 processor according to a first embodiment of the present 
invention; 

FIG. 2 is a flow chart for briefly explaining the 
processing routine of the data processor shown in FIG. 1; 
FIG. 3 is a functional block diagram of a portion 
20 concerned with correlation detection of a correlation 
processing unit shown in FIG. 1; 

FIGS. 4A and 4B are graphs for explaining the 
correlation detection shown in FIG. 3; 

FIG. 5 is a view for explaining the flow of data in 
25 a case of registering a master film MF in the data 
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processor shown in FIG. 1; 

FIG. 6 is a flow chart for explaining an example of 
operation in the case shown in FIG. 5. 

FIG. 7 is a view for explaining the flow of the data 
5 when registering a legally copied film CF in the data 
processor shown in FIG. 1. 

FIG. 8 is a flow chart for explaining an example of 
operation of the case shown in FIG. 7. 

FIG. 9 is a view for explaining the flow of the data 
10 when identifying the legally copied film CF which has 

become the source of leakage of the object film RF in the 
data processor shown in FIG. 1; 

FIG. 10 is a flow chart for explaining an example of 
operation of the case shown in FIG. 9; 
15 FIG. 11 is a view for explaining a data processor 

according to a second embodiment of the present 
invention; and 

FIG. 12 is a view for explaining a data processor 
according to a third embodiment of the present invention. 
20 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Below, an explanation will be given of data 
processor according to embodiments of the present 
invention. The data processor of the embodiments is used 
when for example making a plurality of legally copied 
25 films from a master film of the content of a movie and 
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distributing them to movie theaters. Further, the data 
processor of the embodiments is used for identifying from 
which of the copied films an object film was produced. 
Note that, the master film and the copied films in the 
5 embodiments are recording media having inherent 
variations in recording sensitivity. 
First Embodiment 

FIG. 1 is a view of the configuration of a data 
processor 1 according to a first embodiment of the 

10 present invention. As shown in FIG. 1, the data processor 
1 has, for example, a reproduction unit 10, a camera unit 
11, a characteristic extraction unit 12, an FN generation 
unit 13, a database 14, a database 15, a log conversion 
unit 21, a log conversion unit 23, a difference detection 

15 unit 24, a database 25, a log conversion unit 31, a 

collation unit 32, and a correlation processing unit 33. 
Here, the correlation processing unit 33 corresponds to 
the correlation detecting means and the identifying means 
of the present invention. 

20 The components of the data processor 1 shown in 

Fig.l may be realized by circuits or computer programs. 

FIG. 2 is a flow chart for briefly explaining the 
processing routine of the data processor 1 shown in FIG. 
1. 

25 Step STl: 
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The data processor 1 plays back for example the 
master film MF of the content of the movie, captures an 
image thereof by the camera unit 11, and records digital 
master content data MCD (first content data of the 
5 present invention) in the database 14 . 

Step ST2: 

The data processor 1 plays back each of the 
plurality of legally copied films produced from the 
master film MF (hereinafter also referred to as "the 

10 legally copied films", that is, the recording media of 
the present invention) and captures an image at the 
camera unit 11 to generate digital copied content data 
CCD (second content data of the present invention) . Then, 
the difference detection unit 24 generates difference 

15 data DIF between the copied content data CCD and the 

master content data MCD for each copied film and records 
this in the database 25 . 
Step ST3: 

The data processor 1 generates reproduction data 
20 RPCA ( third content data of the present invention) from 
the film which is an object for inspection (that is, 
object film) • Then, the data processor 1 detects the 
correlation between the reproduction data RPCA and the 
difference data DIF read from the database 25 at the 
25 correlation processing unit 33, decides whether or not 
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there is any common point derived from the inherent 
variations in the recording sensitivity on the basis of 
the correlation, and identifies from which of the 
plurality of legally copied films the film was obtained. 
5 Note that the inherent variations in the recording 

sensitivity occur in the production process of the film 
(recording medium) . Artificial reproduction is difficult. 

Below, an explanation will be given of components 
shown in FIG. 1. 
10 Reproduction Unit 10: 

The reproduction unit 10 plays back the master film 
MF, the legally copied films CP, and the object film RF. 

Camera Unit 11: 

The camera unit 11 is for example a scanner 
15 (telecine) using an area sensor or a line sensor and 

captures an image obtained by the playback operation of 
the reproduction unit 10 to generate the digital content 
data. 

Characteristic Extraction Unit 12: 
20 The characteristic extraction unit 12 extracts 

characteristic quantities of the master content data MCD 
and the identified content data RPCA. The characteristic 
quantity is for example the mean brightness of a center 
portion of the image generated by the content data or 
25 other brightness information or the color saturation, hue. 
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or other information concerning a histogram. Further, as 
the characteristic quantity, it is also possible to use 
one for identifying a frame around a characteristic point 
of change of the video. The characteristic quantity is 
5 used f6r realizing frame synchronization at the time of 
correlation detection between the object content data 
(content data which is an object for inspection) and the 
difference data. 

FN Generation Unit 13: 
10 The FN generation unit 13 generates frame number 

data NF on the basis of signals obtained in the playback 
operation of the film in the reproduction unit 10. 

Database 14 : 

The database 14 stores the frame data MFL whose 
15 characteristic quantity was extracted in the digital 
master content data MCD and the frame nxamber data FN 
thereof linked together by the operation of step STl 
shown in FIG. 2. 

Database 15 : 

20 The database 15 records characteristic quantity data 

MRA indicating the characteristic quantity, the frame 
nxjmber data FN, and the identification data CID of the 
content of the master film MF linked together by the 
operation of step STl shown in FIG. 2. 

25 Log Conversion Unit 21: 
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The log conversion unit 21 logarithmically converts 
the copied content data CCD to generate the copied 
content data CT. In the present embodiment, the log 
conversion is carried out so that a difference derived 
5 from noise is suitc±>ly generated in the difference 
processing in the later difference detection unit 24 
since noise (grain noise) of the film occurs due to 
variations in the recording sensitivity and exist as a 
product of the brightness data (signals) . Note that, it 
10 is not always necessary to perform the log conversion. 
Logarithm Conversion Unit 23: 

The log conversion unit 23 logarithmically converts 
the frame data MFL of the master content data to generate 
the frame data MT. 
15 Difference Detection Unit 24: 

The difference detection unit 24 generates 
difference data DIF indicating the difference between the 
copied content data CT and the frame data MT. 

Database 25: 

20 The database 25 records the difference data DIF, the 

frame number data FN of the frame data used for obtaining 
this, identification data CFID of the legally copied 
films, and identification data CID of the content linked 
together . 

25 Log Conversion Unit 31: 
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The log conversion unit 31 logarithmically converts 
the object content reproduction signal RPCA obtained from 
the object film RF to generate the object content 
reproduction data RCT at step ST3 shown in FIG. 2. 
5 Collation Unit 32: 

The collation unit 32 collates the characteristic 
quantity data RRA of the object content reproduction 
signal RPCA and the characteristic quantity data CRA 
recorded in the database 15 and identifies the frame 
10 number data FN corresponding to the matching 

characteristic quantity data CRA and the identification 
data CID of the content* 

Correlation Processing Unit 33: 

The correlation processing unit 33 detects the 
15 correlation between the difference data DIF sequentially 
read from the database 25 and the object content 
reproduction data RCT input from the log conversion unit 
31, decides whether or not there is any common point 
derived from the inherent variations in the recording 
20 sensitivity on the basis of the correlation data S33 

indicating correlation, and identifies from which of the 
plurality of legally copied films CF the object film RF 
was obtained. 

The correlation processing unit 33 detects 
25 correlation on the basis of the symmetrical phase only 
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matched filtering (SPOMF) method. SPOMF is disclosed in 
^^Symmetric Phase-Only Matched Filtering of Fourier-Mellin 
Transforms for Image Registration and Recognition", IEEE 
Transaction on PattBrn Analysis and Machine Intelllg^ence , 
5 vol. 16, no. 12, December 1994 etc. FIG. 3 is a 

functional block diagram of the portion concerned with 
the correlation detection of the correlation processing 
unit 33 shown in FIG. 1. As shown in FIG. 3, the 
correlation processing unit 33 has, for example, an fast 

10 Fourier transform (FFT) circuit 131, a whitening circuit 
132, an FFT circuit 133, a whitening circuit 134, a 
complex number conjugating circuit 135, a multiplier 
circuit 136, and an IFFT circuit 137. 

The FFT circuit 131 applies for example a Fourier 

15 transform to the object content reproduction data RCT 

input from the log conversion unit 31 to generate first 
frequency component data S131 and outputs this to the 
whitening circuit 132. The whitening circuit 132 divides 
each complex n\amber data forming the first frequency 

20 component data S131 by an absolute value of the complex 
number data (that is, making absolute values of the 
element data equal) to generate first complex number data 
S132 and outputs this to the multiplier circuit 136. 

The FFT circuit 133 applies a Fourier transform to 

25 for example the difference data read from the database 25 
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to generate second frequency component data SI 33 and 
outputs this to the whitening circuit 134 . The whitening 
circuit 134 divides each complex number data forming the 
second frequency component data S133 by the absolute 
5 value of the complex number data to generate second 

complex number data S134 and outputs this to the complex 
number conjugating circuit 135. 

The complex niamber conjugating circuit 135 replaces 
each complex number data forming the second complex 

10 number data S134 by the complex conjugate complex number 
data to generates third complex nvimber data S135 and 
outputs this to the multiplier circuit 136 • The 
multiplier circuit 136 multiplies the first complex 
number data SI 32 and the third complex niomber data SI 35 

15 to generate fourth complex number data S136 and outputs 
this to the IFFT circuit 137. The IFFT circuit 137 
applies an inverse Fourier transform to the fourth 
complex number data S136 to generate the correlation data 
S33. Here, the correlation data indicates all values 

20 obtained by finding correlation by cyclically shifting 

the relative position between the difference data DIF and 
the object content reproduction data RCT in two 
dimensions . 

As shown in FIG. 4A, in a natural image, energy of 
25 the image is concentrated in the low frequency area. 
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Contrary to this, the variations in recording sensitivity 
of recording media (films) are random phenomena, so the 
component superimposed on the image due to the variations 
in sensitivity has almost an equal energy over a broad 

5 frequency component as white noise as shown in FIG. 4B. 
By the collation by the SPOMF mentioned above, after the 
transform to the frequency domain, the absolute values of 
elements are made ecpjal . For this reason, the collation 
of patterns of variations in recording sensitivity of 

10 recording media becomes possible without disturbance by 
the low frequency signal of a natural image. 

For this reason, when an object film RF was not 
prepared on the basis of a legally copied film CF, the 
object content reproduction data RCT and the difference 

15 data DIF become uncorrelated. Namely, a large value is 

not generated at the origin of the correlation data S33 . 
On the other hand, when the object film RF is prepared on 
the basis of a legally copied film CF, the object content 
reproduction data RCT and the difference data DIF are 

20 correlated due to the influence of the inherent recording 
sensitivity of the film. The correlation processing unit 
33 decides that an object film RF was prepared on the 
basis of a legally copied film based on the correlation 
data S33 when the correlation value indicated by the 

25 correlation data S33 exceeds a predetermined value. 
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Below, an explanation will be given of the method of 
determining the value used for reference in the decision 
by the correlation processing unit 33, As mentioned above, 
the correlation data S33 shows all values obtained by 

5 finding correlation by cyclically shifting the relative 
position between the object content reproduction data RCT 
and the difference data DIF in two dimensions. Here, the 
object content reproduction data RCT and the difference 
data DIF are uncorrelated for a picture pattern etc. , 

10 therefore values other than the origin of the correlation 
data S33 indicate accidental correlation values between 
uncorrelated data. The correlation processing unit 33 
finds standard deviation a of the correlation data S33 
and makes a decision using whether or not the value COO 

15 of the origin of the correlation data S33 exceeds a 

predetermined multiple. The value COO was used because, 
when correlation was found between the entire data, the 
inherent patterns of the recording sensitivity of the 
films matched in a state where the origins were made to 

20 match, so a peak appeared in the output COO of the 
correlation in that case. 

Each element data in the correlation data S33 is 
defined as Ci j , while the number of the element data is 
defined as n. The correlation processing unit 33 

25 generates a mean value "mean" of the values indicated by 



all element data in the correlation data S33 on the basis 
of* the following equation (1) : 

cmean = (Zcij)/n 

. . • (1) 

5 Further, the correlation processing unit 33 

generates the standard deviation a on the basis of the 
following equation (2) by using the mean value "mean". 
o = >/{ {j; (ci j-cmean}x (ci j-cmean) }/n> 
... (2) 

10 Then, the correlation processing unit 33 makes a 

decision on the basis of whether or not the value 
indicated by the element data cOO of the origin in the 
correlation data S33 exceeds 10 times (predetermined 
level) the standard deviation a on the basis of the 
15 following equation (3) : 
cOO > 10 X a 
...(3) 

As mentioned above, the correlation processing unit 
33 decides which among the legally copied films CF the 

20 object film RF was prepared by finding the correlation 

between the object content reproduction data RCT and the 
difference data DIF by SPOMF. The probability of 
correctly making the decision can be quantified as 
follows. It can be considered that the result of the 

25 collation of the randomly distributed data follows a 
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normal distribution. When detecting the correlation of 
the content data obtained from different films, it is 
decided that the two sets of data are not correlated. The 
probability of the value of correlation of uncorrelated 
5 data exceeding 10 a is 7.6 x 10"^^. 

Below, an explanation will be given of an example of 
operation of the data processor 1 shown in FIG. 1. 
First Example of Operation: 

In this example of operation, an explanation will be 
10 given of the case of registering the master film MF (step 
STl shown in FIG. 2) . FIG. 5 is a view for explaining the 
flow of the data in this example of operation; and FIG. 6 
is a flow chart for explaining this example of operation. 
Below, an explanation will be given of the steps shown in 
15 FIG. 6 by referring to FIG. 5. 
Step STll: 

The reproduction unit 10 plays back the master film 
MF, captures an image MCA thereof at the camera unit 11, 
and generates the digital master content data MCD. 
20 Step ST12: 

The characteristic quantity extraction unit 12 
extracts the characteristic quantity of the master 
content data MCD and generates the characteristic 
quantity data MRA indicating the characteristic quantity. 
25 Step ST13: 
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In parallel with the above operation, the FN 
generation unit 13 generates frame niomber data NF on the 
basis of the signal obtained in the playback operation of 
the film at the reproduction unit 10. Then, the frame MFL 
5 for which the characteristic quantity was extracted at 
step ST12 in the master content data MCD generated at 
step STll and the frame number data FN from the FN 
generation unit 13 are recorded in the database 14 linked 
together . 
10 Step ST14: 

The characteristic quantity data MRA generated at 
step ST12, the fraone number data FN corresponding to this, 
and the identification data (content ID) CID of the 
content of the master film MF are recorded in the 
15 database 15 linked together. 

Second Example of Operation : 

In this example of operation, an explanation will be 
given of a case of registering a legally copied film CF 
(step ST2 shown in FIG. 2) . FIG. 7 is a view for 

20 explaining the flow of the data in this example of 

operation; and FIG. 8 is a flow chart for explaining this 
example of operation. Below, the steps shown in FIG. 8 
will be explained by referring to FIG. 7. Note that the 
data processor 1 performs the following processing for 

25 all legally copied films CF prepared from the master film 
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MF. 

Step ST21: 

The reproduction unit 10 plays back a legally copied 
film CF prepared from the master film MF, captures an 
5 image CCA thereof at the camera unit 11, and generates 
the digital copied content data CCD. 

Step ST22: 

The log conversion unit 21 logarithmically converts 
the copied (legally copied) content data CCD to generate 
10 the copied content data CT. 
Step ST23: 

The frame MFL of the master content data MCD is read 
from the database 14 and output to the log conversion 
unit 23. 
15 Step ST24: 

The log conversion unit 23 logarithmically converts 
the frame MFL input at step ST23 to generate the frame MT 
and outputs this to the difference detection unit 24. 

Step ST25: 

20 The difference detection unit 24 detects the 

difference data DIF indicating the difference between the 
copied content data CT generated at step ST22 and the 
frame MT input at step ST24 . 
Step ST26: 

25 The database 25 records the difference data DIF 
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obtained by the frame nximber corresponding to the frame 
MT linked together with the frame number data FN, the 
identification data CFID of the legally copied film, and 
the identification data CID of the content data on the 
5 basis of the frame number data FN from the FN generation 
unit 13. 

Third Example of Operation: 

In this example of operation, an explanation will be 
given of a case of identifying the legally copied film CF 

10 which was the source of leakage of an object film RF 
(step ST3 shown in FIG. 2) . FIG. 9 is a view for 
explaining the flow of the data in this example of 
operation; and FIG. 10 is a flow chart for explaining 
this example of operation. Below, an explanation will be 

15 given of the steps shown in FIG. 10 by referring to FIG. 
9. Note that, in the present example of operation, a case 
of not capturing an image reproduced at the reproduction 
unit 10 by the camera unit 11 is illustrated, but it is 
also possible to capture an image at the Ccunera unit 11, 

20 then output image to the characteristic quantity 
extraction unit 12 and the log conversion unit 31. 
Step ST31: 

The reproduction unit 10 plays back the object film 
RF and outputs the object content reproduction signal 
25 RPCA information to the log conversion unit 31 and the 
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characteristic quantity extraction unit 12. 
Step ST32: 

The log conversion unit 31 logarithmically converts 
the object content reproduction signal RPCA to generate 
5 the object content reproduction data RCT and outputs this 
to the correlation processing unit 33. 

Step ST33: 

The characteristic quantity extraction unit 12 
extracts the characteristic quantity of the object 
10 content reproduction signal RPCA and outputs the 
characteristic quantity data RRA indicating the 
characteristic quantity to the collation unit 32. 

Step ST34 : 

The collation unit 32 identifies the characteristic 
15 quantity data CRA corresponding to the characteristic 
quantity data RRA input at step ST33 in the 
characteristic quantity data CRA stored in the database 
15 and identifies the frame n\amber data FN and the 
identification data CID of the content linked to the 
20 identified characteristic quantity data CRA. 
Step ST35: 

The collation unit 32 reads the difference data DIF 
corresponding to the frame number data FN and the 
identification data CID identified at step ST34 from the 
25 database 25 and outputs this to the correlation 



processing unit 33. The collation unit 32 sequentially 
outputs the plurality of difference data DIF obtained on 
the basis of the plurality of copied films to the 
correlation processing unit 33. 
5 Step ST36: 

The correlation processing unit 33 detects the 
correlation between the difference data DIF sequentially 
read from the database 25 at step ST35 and the object 
content reproduction data RCT input from the log 

10 conversion unit 31 at step ST32 , decides whether or not 
there is any common point derived from inherent 
variations in the recording sensitivity on the basis of 
the correlation, and identifies from which of the 
plurality of legally copied films CF the object film RF 

15 was obtained. The correlation processing unit 33 outputs 
the identification data CFID of the legally copied film 
CF identified by this and the identification data CID of 
the content and makes a not illustrated display show the 
content according to need. Note that the identification 

20 data CFID of the legally copied film CF is linked with 
the identification data of the destination of 
distribution at for example the database 25, so it is 
also possible to further display the identification data 
of the destination of distribution on the display. 

25 As explained above, according to the data processor 
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1, it can be identified from which among a plurality of 
legally copied films CF an object film RF was prepared. 
Further, the identification data CID of the content can 
be specified. By recording the destinations of 
5 distribution of legally copied films CF, when an object 
film RF is a pirated copy, it is possible to identify the 
destination of distribution involved in the preparation 
of the object film RF and take measures against copyright 
infringement. 

10 Second Embodiment 

In the first embodiment, as shown in FIG. 9, a case 
where the correlation processing unit 33 detected 
correlation between the object content reproduction data 
RCT from the log conversion unit 31 and the difference 

15 data DIF read from the database 25 was illustrated. FIG. 
11 is a view for explaining a data processor 201 
according to a second embodiment of the present invention. 
In the data processor 201 of the present embodiment, as 
shown in FIG. 11, the log conversion unit 23 

20 logarithmically converts the frame data MFL of the master 
content read from the database 14 to generate the frame 
data MT. Then, the difference detection unit 42 generates 
the difference data DIFR indicating the difference 
between the object content reproduction data RCT and the 

25 frame data MT and outputs this to the correlation 
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processing unit 33. Then, the correlation processing unit 
33 detects the correlation between the difference data 
DIF and the difference data DIFR. 

Effects the same as those by the data processor 1 of 
5 the first embodiment are also obtained by the data 
processor 201. 

Third Embodiment 

FIG. 12 is a view for explaining a data processor 
301 according to a third embodiment of the present 

10 invention. As shown in FIG. 12, the data processor 301 is 
configured as the data processor 201 shown in FIG. 11 
plus a correction unit 51 a the front of the log 
conversion unit 31. The correction unit 51 corrects 
distortion existing in the object content reproduction 

15 signal RPCA from the reproduction unit 10 to generate a 
new object content reproduction signal RPCAl and outputs 
this to the log conversion unit 31 . For example, when the 
object film RF is obtained by capturing the played back 
image of the copied film CF by using a camcorder or the 

20 like and recording the result, distortion is generated in 
the new object content reproduction signal RPCA. In the 
present embodiment, by correcting the distortion by the 
correction unit 51, the precision of the correlation 
detection by the later correlation processing unit 33 is 

25 raised. Note that the distortion mentioned above occurs 
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where a geometric deformation is given to the identified 
content or compression, expansion, recording, 
reproduction, or the like is carried out for the data. 
According to the data processor 301, from which 
5 among the plurality of legally copied films CF the object 
film RF was prepared can be identified with a high 
reliability. 

The present invention is not limited to the above 
embodiments. For example, in the above embodiments, a 

10 film was illustrated as the recording medium of the 
present invention, but the recording medium of the 
present invention is not particularly limited so far as 
it is a recording medium having inherent variations in 
recording sensitivity which can be detected on the basis 

15 of the reproduction data. Further, in the above 
embodiments, the case where the object content 
reproduction data obtained from the object film RF was 
used was illustrated, but the third content data of the 
present invention may be data distributed via a network 

20 etc. too other than that obtained from a recording medium. 
Note that the first content data in the present invention 
does not always have to be obtained from a recording 
medium having inherent variations in recording 
sensitivity. 

25 For example, several thousand copies of films for 
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distribution for the use of movie theaters are prepared 
in a few days, so the speed becomes high (for example 100 
times the showing speed) . The usual telecine is difficult 
in actual circiamstances at this speed. Accordingly, in 
5 the present embodiment, it is also possible to employ the 
technique of for example (1) extracting the noise of one 
or more noncontinuous frames, (2) obtaining shots of 
them by a two-dimensional imager, (3) creating in advance 
a loose portion in the film when the exposure time is not 

10 enough and stopping or slowing the speed of the 

corresponding frame portion for exactly the capture time, 
or (4) placing the camera for capturing the images on a 
rotary stand and matching the camera with the speed of 
the film. Further, it is also possible to employ the 

15 technic[ue of reducing the number of pixels for every 

frame and using part of the screen or reducing the number 
of pixels by blurring by an optical filter or the like. 

Further, in the present embodiment, the difference 
detection was carried out for the specified one frame 

20 data MFL, but it is also possible to use a plurality of 
difference data DIF generated for a plurality of frame 
data MFL. 

Below, an explanation will be given of related art 
of the embodiments . 
25 Electronic Distribution: 
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At present, distribution by film is the general 
practice, but distribution by digital recording on tapes, 
discs, hard discs, or other recording media and 
distribution via the network will probably increase in 
5 the future. In that case, a signal corresponding to the 
noise changed for every destination of distribution is 
inserted into the distribution use copied content. In 
this case, this signal can be controlled, so the amount 
of insertion and waveform can be controlled so that the 

10 collation can be reliably carried out while making it 

visually inconspicuous. In this case, it is also possible 
to record the signal corresponding to the noise as it is, 
but the recording capacity can be made smaller by 
recording the type or functions for generating this 

15 signal . 

Video on Demand (VOD) : 

The invention can be applied for identifying a 
customer who illegally secondarily distributes content 
downloaded or streamed to a specified customer by VOD. 

20 The noise based on the customer number may be inserted 
into the output signal of the content. The same method 
can be used for music on demand (MOD) , but sometimes 
simple random numbers would have a significant effect on 
the sound quality. Therefore, measures are taken aiming 

25 at a masking effect to make it inaudible. In the case of 
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video as well, it is also possible to take measures for 
making the noise invisible. 
Broadcast: 

The invention can be applied to identification of 
5 the owner of a receiver illegally secondarily 

distributing broadcasted content by inserting noise 
formed based on a serial nijmber identifying the receiver. 
In a pay broadcast receiver, the customer concludes a 
contract for conditional access, so if based on the 
10 contract number, the customer (illegal distributor) can 
be more reliably identified. 
Package Media: 

There is also a problem of secondary distribution 
from package media such as digital versatile disks (DVDs) 
15 or cassette videotapes. The same effects can be obtained 
by inserting noise based on a number identifying the 
apparatus in the same way as above. 

Paper Media: 

The same effects can be obtained by inserting noise 
20 based on a customer number for identifying a customer 

illegally secondarily distributing documents, photographs, 
sheets of music, and other copyrighted work output by 
paper. When the gradation is small, general noise will 
not work, so the noise is modulated by the position of 
25 the text etc. to obtain the same effects. 
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Bit Stream: 

Sometimes content compressed by MPEG2 as prescribed 
in the IEEE1394 is output while compressed. It is 
necessary to consider a case of making copies and 
5 secondarily distributing them by this route. If inserting 
noise into the baseband signal as described above, the 
content will be output without superposition of the noise. 
Accordingly, preferably the noise is inserted in the bit 
stream. If the noise is inserted in the bit stream, the 

10 noise ends up being inserted in both outputs since the 

analog output is obtained by decompressing the bit stream. 
It has been known that noise can be inserted in the bit 
stream by operating the DCT coefficient so as not to 
change the code length . 

15 Properties of Noise: 

If assuming that it is possible to extract just the 
noise component by referring to the original text, the 
noise level can be made extremely small, but sometimes 
several measures are necessary if considering the case of 

20 noise disappearing for example due to compression, analog 
recording/reproduction, recapture, etc. First, it is 
preferable in view of tolerance if the noise level is 
raised, but the image quality (sound quality) would then 
deteriorate. To deal with this, it may be considered to 

25 insert a larger amount of noise at the portions of the 
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content where the picture pattern is complex since it 
becomes hard to see there and to insert a smaller amount 
in the conspicuous flat portions. Assioming the noise is 
the same for every frame, the noise is not conspicuous in 
5 a still image, but the noise is conspicuous when the 

picture pattern moves. Accordingly, it the method may be 
considered of making the noise smaller in accordance with 
the movement of the picture pattern in portions where the 
picture pattern moves. Alternatively, a method may be 

10 considered of moving the noise matched with the picture 
pattern according to a certain predetermined rule. When 
the noise is the same for every frame, sometimes it is 
possible to extract just the noise by superimposing a 
large number of frames. It is possible to subtract the 

15 extracted noise from the content to eliminate the noise 
or to superimpose the noise from another party's content 
to disguise oneself as the other party. In order to cope 
with this, the noise is changed in a predetermined 
relationship with the components of the content. 

20 Electronically prepared content has little noise in 

comparison with film. However, there are quite a few 
people who feel this to be unnatural since they are used 
to the noise of films. In actuality, there is an 
invention of an apparatus inserting noise resembling film 

25 (for example, the apparatus and method of generating a 
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video disclosed in Japanese Unexamined Patent Publication 
(Kokai) No. 9-508507) . It is considered that the noise 
should be as near the noise of film as possible. 
Accordingly, the method of extracting the noise by taking 
5 the difference at the time of copying film was explained. 
This method is truly the preferred method for generating 
noise. At this time, if the master film is a gray flat 
image, there is no longer intexmixture of non-noise 
components. Namely, where the content is distributed not 

10 in the form of film, but in the form of electronic media, 
the noise for the collation (correlation detection) is 
inserted before distribution so that is becomes different 
for every destination of distribution. Further, when the 
content is distributed in the form of electronic media, 

15 the noise is inserted based on information related to the 
recipient by hardware or software at the reception side 
such as the content receiver or reception software. 

Sxommarizing the effects of the invention, as 
explained above, according to the data processing method 

20 of the present invention and the apparatus of the same, 
it is possible to identify if third content data was 
obtained on the basis of a predetermined recording medium. 

While the invention has been described with 
reference to specific embodiments chosen for purpose of 

25 illustration, it should be apparent that nvimerous 
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modifications could be made thereto by those skilled in 
the art without departing from the basic concept and 
scope of the invention. 



